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Abstract. 

We study the geometrical structure of the states in the low temperature phase of a mean field model for 
generalized spin glasses, the p-spin spherical model. This structure cannot be revealed by the standard 
methods, mainly due to the presence of an exponentially high number of states, each one having a 
vanishing weight in the thermodynamic limit. Performing a purely entropic computation, based on the 
TAP equations for this model, we define a constrained complexity which gives the overlap distribution of 
the states. We find that this distribution is continuous, non-random and highly dependent on the energy 
range of the considered states. Furthermore, we show which is the geometrical shape of the threshold 
landscape, giving some insight into the role played by threshold states in the dynamical behaviour of the 
system. 



PACS number: 75.10.N, 05.20, 64.60.C 



1. Introduction. 



Despite some recent developments [1,2,3], a deep understanding of the structure of the states in the 
p-spin spherical model is still lacking. The problem is the following: 

In the context of the TAP approach [4], it has been shown that, in the temperature range between 
the static and the dynamical transition, this model has an exponentially high number of states (TAP 
solutions), with free energy densities in a finite range [f m in, fth]- What happens is that equilibrium states 
at temperature T are not the lowest ones corresponding to f m in, but rather those which optimize the 
balance between the free energy and the entropic contribution due to the presence of a great number of 
states with the same free energy. Thus equilibrium states are those which minimize the generalized free 
energy density </>(/) = / — TE(/), where £ is the complexity. The states with free energy density / either 
lower or larger then the value which minimizes <f) must be considered as metastable. On the other hand, 
all these states, the equilibrium as well as the metastable ones, singularly taken have a vanishing weight 
in the thermodynamic limit. In this sense, an equilibrium state is not different from a metastable state, 
since the equilibrium condition is a fully collective effect [1,5]. 

It is clear that the presence of this huge number of states makes it interesting to know how they are 
disposed in the phase space, and therefore to investigate their distribution and structure. 

To clarify what we intend with structure of the states it is useful to think about the Sherrington- 
Kirkpatrick (SK) model [6]. In this case, in the context of the replica method, the solution given in 
[7,8,9] has permitted to define and calculate the overlap distribution P(q) of the pure states: P(q) is 
defined as the probability that, picked up two states, their mutual overlap is equal to q. Therefore, in the 
distribution P(q) two different contributions are present: the existence of states having mutual overlap q 
and their individual statistical weights. The function P(q) gives for the SK model an important structural 
information on the distribution of the states in term of the overlap [10]. 

For the p-spin spherical model we would like to have a structural information of the same kind as the 
one given by the distribution P(q) for the SK model. 

Unfortunately, it is known that applying the standard replica method to the p-spin spherical model a 
trivial result is obtained [11]: in the intermediate temperature phase that we are considering, the model 
is solved by a replica symmetric solution, corresponding to a trivial distribution function P(q) = 5{q). 
This delta function simply means that the typical overlap between two states is zero. On the other hand, 
one can wonder why this distribution does not get contribution from the self overlap of the equilibrium 
states, which is different from zero. The answer is that all these states have singularly a weight so low 
that the contribution of their self overlap is not present in the distribution P{q). In other words, it is 
highly unlikely to pick up twice the same state and measure its self overlap, either if this is an equilibrium 
state or a metastable one. 

For the same reason it is possible that the distribution P(q) does not catch a contribution from all the 
other possible values of the overlap q, simply because picking up two states with overlap different from 
zero has a vanishing probability in the thermodynamic limit. This would mean that the trivial form of 
P(q) is not a consequence of the absence of states with mutual overlap different from zero, but rather of 
the difficulty of finding them [12]. On the contrary, there is the possibility that indeed all the states of 
this model have mutual overlap zero, i.e. that states with overlap different from zero do not exist at all. 
In this last case it is clear that there would be only a trivial structure of the states, exactly reproduced by 
a trivial P(q). The standard static approaches cannot distinguish between these two pictures, and more 
than this, in the case in which a non trivial hidden structure were present, they are not able to give us 
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any insight into the problem. In our opinion it seemed very strange to have this huge number of states 
without any interesting geometrical structure and therefore we have tried to develop some non standard 
methods which could provide some information on this topic. 

The first question to answer is then if a non trivial structure of the states, worth being investigated, 
exists. This question has been partially answered in the context of the real replica method, by the 
definition of a three replica potential [3]. Within this method it has been possible to demonstrate that, 
given an equilibrium state, there are other states, both metastable and equilibrium, at any value of the 
overlap q with it, until a certain maximum value. This shows clearly that a non trivial structure of the 
states for this model is present, and that the second picture we have stated above has to be discarded. 
On the other hand, the shape of the energy spectrum of the states found with this method was not 
completely understood and besides there was no control on the choosing procedure of the detected states. 

Therefore it is necessary to define a tool by which the hidden structure of the states for the p-spin 
spherical model can be analyzed in a deep way. Yet, as we have seen, there is the problem of the vanishing 
weight of these states, that leads to the trivial form of the standard distribution function P(q). 

Bearing this in mind, the most natural thing to do is to perform a purely entropic computation, 
disregarding the thermodynamic weight of the states. Thus, what we have done is to fix a reference state 
in the phase space and simply count how many states of a given kind are present at overlap q with it. 
More precisely, what we have actually computed is the number of TAP solutions having a given overlap 
q with a single fixed solution. The resulting quantity is what we have called the constrained complexity 



To conclude this Introduction we want to stress a point that could seem trivial, but that has some 
importance in our opinion. We said that we wanted to study the structure of the states of this model, 
but actually we work with solutions of the TAP equations. The underlying hypothesis is then that TAP 
solutions really correspond to thermodynamic states, intended as local minima of the true free energy 
of the system. This is not a trivial identification, but it has been confirmed in various ways [2,13,3]. 
For example, in the case of the three replica potential of [3], one can show that the local minima of 
the potential, which correspond to metastable states of the system, always have a free energy and a self 
overlap that satisfy TAP equations. 

The Paper is organized in the following way: In Section 2 we define the constrained complexity and 
describe the way in which the calculation has been performed. The main results are exposed in Section 
3, where the behaviour of S c is analyzed and interpreted in terms of geometrical structure of the states. 
In Section 4 we address the question of which are the dominant states at a certain distance from a 
reference equilibrium state, while in Section 5 we focus on the structure of the threshold states, which are 
important under many respects. In Section 6 we state the conclusions and outline the most important 
open problems. Finally, the comparison with the results of the real replica method is carried out in a 
detailed way in Appendix A. 



2. The constrained complexity. 

The p-spin spherical model is defined by the following Hamiltonian 




(2.1) 



ii<...<i p 
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where the spins s are real variables satisfying the spherical constraint s? = N (N is the size of the 
system) and the couplings J are Gaussian variables with zero mean and variance p\/2N p ~ 1 [14,15,11]. 

In the frame of the TAP approach [4] , one formulates mean field equations for the local magnetizations 
fn% = (si) of the system. In [1] it has been introduced a free energy density /tap, function of the 
magnetizations m,, minimizing which one obtains the TAP equations of the system. Solving these 
equations at T = one finds minima of /tap with energy density included in a finite range [E min , E t h] ■ 
The solutions with the highest energy density E t h are usually called threshold solutions. For each value 
of the energy density E in this range, there is an exponentially high number of solutions 

Af(E) ~ e N ^ (2.2) 

where T,(E) is the complexity of the class of TAP solutions corresponding to that particular energy. The 
complexity T,(E) for this model has been computed in [5], where it is found that S is an increasing 
function of E, which is zero for E = E m i n and reaches a finite value for E = E t h- Moreover, due to 
the particular homogeneity of the Hamiltonian, there is a one to one mapping of the solutions found 
at temperature zero, into solutions at finite temperature T, without splitting nor merging of solutions 
with varying the temperature. Due to this, one can solve TAP equations at T = 0, obtaining a class of 
solutions with a certain zero temperature energy density E and then transport these solutions to finite T. 
Therefore from now on we will identify a TAP solution with its zero temperature energy density E, even 
if we are considering this solution at finite temperature T. The important thing is that the complexity 
£(£■) of a given class does not depend on T, but only on the zero temperature energy E of this class, 
while the self overlap of each solution depends both on E and on the temperature T. 
We now introduce the constrained complexity: 



^ c {E 2 ,q\E x ) d ^ lim ^ \ogN(E 2 , q\E x ) . (2.3) 

In this definition Af(E 2 \q, E\) is the number of TAP solutions with energy density E 2 having overlap q 
with a single fixed solution of energy density E\. The bar indicates the average over the disorder. What 
we are doing here is to fix a single state of energy E\ and simply count how many states of energy E 2 
are found at overlap (distance) q with it. We remark that q is the overlap between these TAP solutions 
at finite temperature, while E\ and E 2 are their zero temperature energy densities. 

In definition (2.3) we have averaged the logarithm of Af, since we expect that this is the extensive 
quantity. Therefore, to perform this average it is necessary to introduce replicas. However, it can be 
shown that in the unconstrained case [5], the correct ansatz for the overlap matrix is symmetric and 
diagonal and this is equivalent to average directly the number Af of the solutions. In our case the same 
prescription leads to the following definition: 

£ c (£2,g|£i) =' lim ^-\ogM(E 2 ,q\E 1 ) (2.4) 

and this is the quantity we shall compute. It is surely possible that the introduction of the constraint q 
requires a breaking of the replica symmetry and therefore definition (2.4) has to be considered as a first 
approximation. Yet, as we shall show, the results obtained with formula (2.4) suggest that this is a good 
approximation. 

The complexity S c can be obtained by counting all pairs of solutions with energies {E\,E 2 ) at mutual 
overlap q and dividing it by the number of solutions with energy E\, i.e. 



1 



1 , , — 1 



S c (£i,g|£7i)= lim \ - \ogtf{E u E 2 , q) - - logA/W = E 2 , q) - E(£i) (2.5) 



def 
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where is the usual unconstrained complexity computed in [5]. We note that the quantity T is 

symmetric in {E\,E 2 ) while S c is not. Moreover, r(_Ei,_E 2 ,0) = S(-Ei) + T,(E 2 ), since almost all TAP 
solutions are mutually orthogonal, and then 

E c ( J B 2 ,0|S 1 ) = S( J B 2 ) . (2.6) 

This is the first check we have to face in our calculation. 

Let rn^p and mf^ be two solutions with self overlaps q\ and (72, and mutual overlap q; using the 
notation m ■ m' = J^i m i m i, we have 

m (l) . m (l) = Nqi . m (2) . m (2) = Nq2 . m (l) . m (2) = jy g (2.7) 

Following [1] we write TAP equations in terms of the angular part of the magnetizations m, 

(1) (2) 

°i - —= , n = —— (2.8) 

V^l V^2 



for which it holds 



a-a = N ; t-t = N ; cr-r = N—=L= = f Nq . (2.9) 

V?i92 

In terms of the angular variables a and r, the TAP equations read 

= -? ^ Ji,i2...i p o- i2 ...o- ip -pE 1 a i d = Ti(a; E{) , i = l,...,JV (2.10) 

i2<---<i P 

where E\ is the zero temperature energy density 

i 1 <...<i p 

Relations of the same kind of (2.10) and (2.11) hold for r and E 2 . It is now possible to write T with the 
standard method of [16,5] in the following way: 



T{E u E 2 ,q) 



= llo g y VP{J) J Vo-VtH 8(Ti(a; Ei)) 5(%{t-E 2 )) 
x5{<t-o--N)5{t-t- N) 5{a-T- Nq a ) 



dct 



dTja-E^ 
da 



dct 



( dT{r-E 2 ) 
\ 8t 



(2.12) 

with 

VP(J)= 1] J^^M-JL, p N p ^/p\)dJ H ... lp . (2.13) 

ii<...<i p V 

We note that the dependence on the temperature is entirely contained in q through qi and q 2 , functions 
respectively of E\,E 2 and (3 [1]. 

In formula (2.12) we can drop the two modulus since it is possible to check a posteriori that the 
determinants are positive. Actually, this is a tricky point. As shown in [17,18], if one counts the 
stationary points of a function neglecting the modulus in integrals of the kind (2.12), a trivial result 
is obtained, due to the Morse theorem. Nevertheless, we note that we are not calculating here the whole 
number of stationary points of the TAP free energy, but we are counting those with a given energy density. 
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Moreover, for energies lower than the threshold, the dominant contribution to the determinant is truly 
positive, as can be shown by computing the Hessian spectrum of the TAP free energy. On the other 
hand, the same procedure of removing the modulus gives the normal unconstrained TAP complexity of 
[5], which has been confirmed in [2] with a totally different method. 

In order to perform the calculation it is useful to write both these determinants by means of a 
Fcrmionic representation 

det A = J d^dtp e -£„& A «*i (2.14) 

while the usual (Bosonic) integral representation is adopted for the delta functions which implement 
the TAP equations in (2.12). The average over the disorder J generates couplings among Bosonic and 
Fermionic variables, but these mixed couplings are set equal to zero as in the unconstrained calculation. 
In this way it is possible to average separately the Fermionic part from the Bosonic one. This simplifies 
a lot the calculation, since it turns out that the Fermionic part has exactly the same form as in the 
unconstrained case, while, due to the presence of the constraint q , this is no longer true for the Bosonic 
part. We can write the unconstrained complexity in the usual following way (see [5]): 

£(25) = E(E) Bosons + fi(-E) Fermions (2-15) 

with 

~(E)= l -\og(2/p)- l --E 2 ■ Q(E) = - P Ez-^^z 2 - log z (2.16) 



-E- ^E 2 -2{p-l)/p 



(2.17) 



(P-1) 

Similarly, for what said above, we can write 

T(E 1 ,E 2 ,q) = A(E 1 ,E 2 ,q)+n(E 1 ) + n(E 2 ) (2.18) 
where A is the Bosonic contribution to (2.12). In this way S c has the form 

E c (E 2 ,q\E 1 ) = A{E 1 ,E 2 ,q)-E{E 1 ) + n(E 2 ) . (2.19) 

Besides the variables a and r there are two more Bosonic fields coming from the integral representation of 
the delta functions, respectively fi and A. All these Bosons couple because of the average over the disorder 
J. To perform the saddle point approximation we introduce the following set of variational parameters: 

Nxi = n ■ n ; Nx 2 = A • A ; Nx 3 = fj, ■ A 
Nyi = a ■ fj, ; Ny 2 = r ■ A ; Ny 3 = a ■ A ; Ny 4 = r ■ [i . 
We remind that a ■ t — Nq , while a ■ a = t ■ t = N . The explicit calculation gives 
A(E u E 2 ,q) = 

. / • rp . ■ p p-2 Pf , X V p-1 

' ^xt <j ipEiyi + ipE 2 y 2 q^ y 3 y A - -{x x + x 2 ) - -q% x 3 ^ ^ 



(2.20) 



-(2/1+2/2) + o l0 § 



4 ' ^' • 2-~°\l-ql 

with 

A = [ Xl (l - ql) - fci][ar 2 (l - q 2 ) - k 2 ] - Ml - ql) - k 3 } 2 (2.22) 

fci = V\ - 2<7o?/i2/4 + vl 5 k 2 = yl- 2q y 2 y 3 + y\ ; k 3 = y ± y 3 - q (yiy 2 + y 3 yi) + y 2 Vi (2.23) 

and we remind that q = ql ^q\q 2 . The saddle point equations are easily solved numerically, while it is 
possible to check analytically that for q = we have A(Ei,E 2 ,0) — £(£d) + S(i? 2 ) and then equation 
(2.6) is fulfilled. 
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3. Normal and anomalous regimes. 

In this Section we analyze the dependence of the constrained complexity S c on E 2 and q, at a fixed 
value of Ei. In particular, we focus our attention on the dependence of E c on the overlap q, since we are 
interested in the overlap spectrum of the system, this giving information on the geometrical distribution 
of the states in the phase space. In what follows it is always assumed T 6 [T s , Td] , where T s and Td are 
respectively the static and the dynamical transition temperatures. 

As a value for the reference energy E\ we choose E\ = E eq (/3), where E eq ((i) is the zero temperature 
energy density of those TAP solutions that dominate at temperature /3; in this way, we are fixing an 
equilibrium state and counting how many states of energy density E 2 are present at distance q from 
it. We stress however that we could choose any other value for the reference energy E\, obtaining 
qualitatively the same results. 

It is useful to distinguish two different regimes: a normal regime, corresponding to values of E 2 well 
below the threshold, in which geometrical considerations at least qualitatively apply, and an anomalous 
regime, characterized by values of E 2 just below the threshold, which shows a rather peculiar behaviour 
of S c . 

• The normal regime: 

The normal regime is defined by values of the energy E 2 of the states we are counting well below the 
threshold energy E t h- Intuitively, we expect that S c decreases with increasing q, since this corresponds 
to consider smaller and smaller portions of the phase space into which looking for TAP solutions. This is 
indeed what happens in the normal regime, as shown in Figure 1, where we have plotted S c as a function 
of q. 

0.015 | 1 1 1 




Figure 1: The constrained complexity S c as a function of the overlap q (full line), with Ei=E2=E sq = — 1.156, for /3=1.64 
and p=3. The self overlap of the two states is q 1 =q 2 =0.55, while S c =0 at <j last =0.25. The dashed-dotted line is the curve 
predicted by a random distribution of the states (see the text). For 9=0 both the curves coincide with the unconstrained 
complexity E(E 2 ). 

This curve provides us some important information: First of all this is a continuous curve, meaning 
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that there is a continuous spectrum of states with energy E 2 around the fixed reference state of energy 
E\ (in Figure 1 we have set E 2 = E eq ). This means that there is an exponentially high number of states 
at any value of q, until a value qi ast for which S c = 0. Thus qi ast gives the overlap of the nearest states 
with energy E 2 . It is important that, as long as E\ and E2 are different from E t h, this value qi as t is 
smaller than the self overlap of the considered states. This gap between the last value of the overlap 
in the spectrum and the self overlaps q\ , q 2 simply means that these states are well separated one with 
respect to the other, i.e. 

- gjgg= < 1 . (3.1) 

This has to be compared with the case of the Sherrington-Kirkpatrick model [6] in which as well as in 
this case there is a continuous distribution of states, but with mutual overlap going from q = up to the 
self overlap q — qEA [10,19]. 

The second important feature of Figure 1 can be caught if we compare S c with the corresponding 
quantity that would be obtained in the case of a random distribution of the states. The simplest hypothesis 
we can formulate on the geometrical structure of the states is that they are randomly distributed in the 
phase space: in this case, the number of states at distance q from a given fixed point in the phase space 
would be simply given by the total number of states multiplied by the volume of the manifold defined by 
fixing q, i.e. 

^random = X{E 2 ) + ^ log (l - -^—) (3.2) 

* V 5152/ 

where T,(E 2 ) is the unconstrained complexity and q\, q 2 are the self overlaps of the two solutions. If we 
plot this quantity as a function of q and compare it with T, c (q) (Figure 1), it can be seen that there is 
a violation of the random distribution and that this violation goes in the direction of having an higher 
number of states when looking at small distances. 




Figure 2: The constrained complexity S c (full line), compared with the random distribution (3.2) (dashed-dotted line) for 
p=30. All other parameters arc the same as in Figure 1. 



The comparison with the random distribution of the states suggests an interesting check. It is known 
that the p-spin model in the limit p — > oo coincides with the Random Energy Model of [20], which 
is characterized by a complete decorrelation of the energy levels of the system. Therefore we expect 
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that for increasing values of p the constrained complexity E c gets more and more similar to the random 
distribution (3.2). This is shown in Figure 2, where we see that for p = 30 it remains only a little tail 
for large q in which the two distributions are different. For p — > oo they coincide. We note that in the 
Random Energy Model there is no geometrical structure at all. What we have here is that a complete 
energetic decorrelation between different states corresponds to a complete geometrical decorrelation in 
the phase space. 

Finally we consider the dependence of S c on the energy E 2 of the states that we are counting. In 
Figure 3 we have plotted T, C (E 2 ) at various values of q. The curve on the top corresponds to q = and 
then reproduces the unconstrained complexity Y,(E 2 ) (see equation (2.6)). We note that, even at fixed 
q 7^ 0, S c increases with increasing E 2 , as in the unconstrained case. Furthermore, as expected, the whole 
curve T, c (E 2 ,q) decreases with increasing q. 

0.015 i 1 1 1 n 




-1.17 -1.165 -1.16 -1.155 

E 2 

Figure 3: The constrained complexity S e as a function of the energy E 2 , at various values of the overlap q and E\=E aq = 
— 1.156, for /3=1.64 and p=3. The first curve on the top has 9=0 and thus corresponds to the unconstrained complexity 
E(_E 2 ). The threshold energy is E t(l =— 1.1547. The squares indicate the minimum of the function tpc (see Section 4), which 
reaches the axis S c =0 at q loro =0.113. 



• The anomalous regime: 

We turn now to examine the anomalous regime. If we plot S c as a function of E 2 exactly as in Figure 
3, but now expanding a narrow range of energies E 2 just below the threshold (E e [E t h — 5 x 10~ 4 , E t h\), 
we obtain the behaviour shown in Figure 4. 

The curves get lower and lower with increasing q, until for a value of q that we call q max they begin to 
reverse, folding upwards. In Figure 4, q max corresponds to the curve whose intersection with the S c = 
axis starts going backward to the left with increasing q. If now we make a section of these curves at a 
fixed value of E 2 in this range, plotting S c as a function of q, wc find the anomalous behaviour of Figure 
5: there is an interval of q where E c increases with increasing q. 
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-1.1553 -1.1551 -1.1549 -1.1547 

E2 

Figure 4: The constrained complexity S e as a function of the energy E 2 just below the threshold, at various values of q. 
The value q max corresponds to the curve whose intersection with the axis S e =0 starts going to the left with increasing q. 




Figure 5: The constrained complexity E c as a function of the overlap q in the anomalous regime. Ei=E sq and E2=-1.1550. 

The reversed behaviour of S c clearly has not a geometrical origin and for this reason we talk of an 
anomalous regime. What it seems is that, given a state (in this case an equilibrium state), there is a 
sort of clustering of states with high energy at small distances (large overlap) from it, thus giving the 
distribution of Figure 5. Moreover, from Figure 4 we note that for high enough values of q, S c is no 
longer monotonic with respect to E2, and it develops a maximum. Therefore, in this range of q threshold 
solutions are no longer the most numerous around the fixed equilibrium state. 

To conclude, we note that the amplitude of the anomalous regime depends on the reference energy 
Ei : the range of energies E2 into which this anomalous behaviour occurs is larger for low values of E\ 
and shrinks to zero as E\ approaches E t h- 
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4. The spectrum of the dominant states. 

At a first sight the increasing of E c with q, together with the role of q max in the anomalous regime 
could seem an artifact of the calculation. Nevertheless, how we are going to show, this behaviour is able 
to explain the energy spectra obtained with the real replica method of [3], where a completely different 
kind of computation is performed. 

To face this problem we have to ask: Which are the dominant states at overlap q from a given fixed 
state ? In the unconstrained case [1,5,13], equilibrium states of the system are defined as those TAP 
solutions that minimize the generalized free energy density <p(f) = f — T'E(f). Similarly, we can wonder 
which solutions dominate at distance q from a given equilibrium state. To this end we look for the 
minimum of the function <fi c (f, (?) = f — TT, c (f, q), with Ex — E eq and S c expressed as a function of the 
free energy density / of the states found at distance q. In Figure 3, for each given value of q, we have 
signed on the corresponding curve the point that minimizes (fi c . As it is easily seen, there is a value of q 
for which the minimum of <j> c reaches the axis E c = 0. We call this value qi ow . If we look for a minimum 
of 4> c when q > qi ow we would be brought to a negative value of S c , i.e. to non existing solutions (in the 
limit N — > oo). In this situation, the dominant solutions are those with the lowest energy density and a 
non negative value of the complexity, i.e. with S c = 0. Due to this, at qi ow there is a sharp change in 
the energy behaviour of the dominant solutions: this energy decreases following the minimum of <f> c until 
q = qiow, then, for higher values of q, it increases following the intersection of the curves £ c (i?2) with 
the axis S c = 0. Yet, from Figure 4 we see that when q reaches q maxi due to the anomalous behaviour 
of S c this intersection point inverts its direction, and so the energy of the dominant solutions starts to 
decrease. 

We conclude that the energy density of the solutions dominating at distance q from a fixed equilibrium 
state has a cuspid for q = qi ow and reaches a maximum at q = q m ax- What said above is shown in Figure 
6. 



-1.156 
-1.158 
-1.16 
-1.162 



0.1 0.2 0.3 0.4 0.5 

q 

Figure 6: The energy density E 2 of the solutions dominating at distance q from the fixed equilibrium solution. The cuspid 
is at <j; otl ,=0.113 and the maximum is at <j max =0.360. The last point of the curve represents the distance of the nearest 
solutions. 

In the real replica method usually a first replica is quenched into an equilibrium state, while a second 
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replica is forced to thermalize at distance q from it [2,3]. It is then natural to think that the second 
replica thermalizes into one of the states that dominate at distance q in the sense described above, and 
that therefore the spectrum of the states visited by this second replica is of the same kind as the spectrum 
of Figure 6. This is indeed what happens, as shown in more details in Appendix A: the spectrum found 
with the real replica method of [3] presents a cuspid, and has a maximum exactly at q = q m ax, thus 
providing a confirmation of the existence of the anomalous regime. 

In analyzing Figure 6 it is important to note that the number of dominant states is exponentially 
high in N as long as q < qi ow , while it is of order N for q > qi ow . In terms of constrained systems this 
transition is signaled by the breaking of the replica symmetry in the overlap matrix and this is another 
confirmation of the consistency of these two different methods (see Appendix A) [3,21]. 

The ending point of this curve corresponds to that value of the overlap above which no states of any 
energy are found with S c > 0. Thus it indicates which is the overlap with the fixed state of energy 
Ei = E eq of the states nearest to it. It turns out that these nearest states have an energy density greater 
than the energy E eq of the fixed reference state, even if in general they are not threshold states. What 
is important is that this is not a special feature of the equilibrium states: indeed, given a state of any 
energy E\ , the states nearest to it always have an energy density greater than E\ . 

This behaviour is not a trivial consequence of the fact that states with higher energy arc in general 
more numerous, since following this reasoning the nearest states would always be the threshold ones 
(which have the greatest unconstrained complexity), while we know that this is not true. Indeed, as 
mentioned in Section 3, at large values of the overlap q, i.e in the anomalous regime, threshold states are 
no longer the most numerous around a given fixed state. Once the curve of the dominant states of Figure 
6 develops a maximum at q ma x , it is not obvious which should be the energy of the states corresponding 
to the ending point of this curve. 



5. The threshold states. 

We turn now to examine the structure of the threshold states. We remind that threshold states are 
those solutions of the TAP equations with the highest energy density E t h- These states have a great 
importance under several aspects. 

From a static point of view it can be shown that threshold states are marginal: the typical spectrum 
of the free energy Hessian evaluated in a TAP solution of energy E is a semicircle with support in the 
positive semi axis and its lowest eigenvalue A mi „ goes to zero as E goes to E t h- In this sense threshold 
states develop some fiat directions. 

On the other hand, in the temperature range T < Td, threshold states play a fundamental role in 
the off-equilibrium dynamics of this model. Solving analytically the dynamical equations with random 
initial conditions (i.e. high energy initial conditions), one finds that the asymptotic limit of the energy 
£oo coincides with the threshold energy E t h- In other words, the asymptotic dynamics takes place at 
the threshold level, never visiting the sub threshold landscape. Moreover, the dynamical evolution of the 
system presents a first equilibrium regime in which the correlation function goes to the value of the self 
overlap of the threshold states q t h, followed by an off-equilibrium aging regime in which the correlation 
function goes to zero, this meaning that the system never truly thermalizes into any of the threshold 
states, but that rather it continuously drifts away [22]. 
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Therefore it is intriguing to investigate the eventual relations between the peculiar dynamical be- 
haviour that occurs at the threshold level and the geometrical structure of the threshold states. 

To perform an analysis of this kind we set E\ = E 2 = E t h, and we study the constrained complexity 
S c as a function of q, i.e. we fix a threshold solution and count how many other threshold solutions are 
present at distance q from it. The corresponding curve is shown in Figure 7. 

The important result is that 

£ c (<?)^0 for q^qthW) (5.1) 

where qth{P) is the self overlap of the threshold states at the temperature /3 we are considering. More 
precisely we find 

£ c (g) ~ (ith - q f for q~ qth ■ (5.2) 
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Figure 7: The constrained complexity E c as a function of q with E 1 =E 2 =E th , for /3=1.64 and p=3. For g>0.35 the curve 
is indistinguishable from the axis and it reaches zero for <j =I j t)l =0.504. 

When the overlap between two states of the same kind is equal to their self overlap, it means that 
these two states are coincident in the thermodynamic limit. Thus, thinking of well separated states, one 
expects that E c goes to zero at a value of q which is lower than the self overlap: indeed this is what 
happens for all the states below the threshold (see Figure 1 and equation (3.1)). 

On the other hand, from (5.1) we see that, fixed a threshold state, other threshold states with vanishing 
complexity are found until a distance zero from the fixed one. A similar conclusion was deduced in [3], 
but in that context it was possible to state this result only at the dynamical transition temperature 
/3 = (3d, at which threshold states are the equilibrium ones. Here we see that this remains true at any 
temperature, as a natural consequence of the non chaoticity of TAP solutions with temperature. 

As a consequence of equation (5.1) we can say that there is no sharp separation among threshold 
states, and that they rather form a structure of coalescent states. This means that these states are 
separated by free energy density barriers which are vanishing in the limit N — > oo, i.e. that the free 
energy barriers grow as N a with a < 1 [23]. 

As previously said, these states are minima of the TAP free energy with some flat directions. We can 
then argue that they are connected along these flat directions, forming a sort of channel of states. Into 
this frame the dynamical drifting of the system (i.e. the decreasing to zero of the correlation function 
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in the off-equilibrium regime) can be viewed as a wandering along this channel of threshold states, in 
agreement with the ideas outlined in [22]. 

Finally, we note that, due to equation (5.1), the distribution of threshold states has no gap between 
the last value of the overlap in the spectrum and the self overlap, unlike all other sub threshold states. 
This feature is reminiscent of the overlap distribution in the Sherrington-Kirkpatrick model. Besides, we 
remind that in the SK model all the states are marginal, as it happens for the threshold states in the 
p-spin spherical model. From this point of view, we can say that threshold states are the most SK like. 



6. Conclusions and open questions. 

The p-spin spherical model for T s < T < Td is dominated by an exponentially high number of states, 
each one having a rather high free energy density / and therefore very small weight. This high free 
energy is counterbalanced by the entropic contribution of the complexity. Besides these equilibrium 
states, there is a great variety of metastable states, with free energy densities both lower and larger than 
the equilibrium one, all having a vanishing weight. In this sense, there is no real difference between 
equilibrium and metastable states, being the equilibrium a collective property. 

In this situation, the standard replica approach fails, since it is not able to discriminate the overlap 
relations among all these states, while the TAP approach gives no information on the overlap distribution 
of them. 

We have faced this problem introducing an overlap q between different TAP solutions and performing 
a purely entropic computation of their number. In this way we have defined a constrained complexity 
T, c (q), which plays the role of the overlap distribution of the states. 

By means of S c we have found that the states are disposed in a non trivial way: fixed an arbitrary 
state from which observing the phase space, there is a continuous spectrum of states surrounding it. This 
means that there are states at each value of the overlap q with the reference one, from q = until a 
maximum value qi ast ■ For sub threshold states there is a gap between this last value of the overlap and 
the value of the self overlap, meaning that they are well separated states. Moreover, the distribution is 
different from the one obtained supposing a random distribution of the states, since it shows a major 
crowding of states at small distances. Yet, the two distributions coincide in the p — ► oo limit, when the 
case of the Random Energy Model is recovered. 

Furthermore, the analysis of threshold states has given some interesting results: these marginal states 
have an overlap distribution which goes continuously to zero at a value of q equal to their self overlap 
qth- This means that these states are connected along their flat directions, forming a sort of channel that 
winds along the phase space. This feature may have a role in the asymptotic dynamics of the system, 
which occurs at the level of the threshold landscape. 

To comment the continuous distribution of the overlap, and in particular the coalescent structure 
of the threshold states, we have often referred to the SK model, for which a continuous structure with 
respect to the overlap q is directly given by the standard distribution function P(q). However, in doing 
this comparison it is necessary to make some specifications. In the ultrametric structure of the SK model 
the main role is played by the equilibrium states, which have the lowest free energy and finite weight, and 
whose number is of order N. This means that one can disregard the exponentially high number of states 
with higher free energy and vanishing weight (this can be done by introducing a cut-off on the branches 
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size of the ultrametric tree [24]). The situation for the p-spin spherical model is somehow the opposite: 
here the states, both of equilibrium and metastable, all have vanishing weight and are in exponentially 
high number. Therefore none of these states, whatever energy it has, can be disregarded. In this sense 
the investigation of the structure of the states for this model is complicated by the existence of a new 
relevant variable, that is the energy. 

Moreover, we stress that there is at the present moment no evidence of an ultrametric organization 
of the states in the p-spin spherical model. To investigate this point it would be necessary to analyze the 
correlation among triplets of states, as it has been done for the SK model in [19]. The only fair indication 
of a clustering structure of the states comes from the existence of the anomalous regime, into which the 
constrained complexity grows with the overlap q. The existence of this anomalous regime is confirmed 
by the real replica method. 

By means of the constrained complexity we have also obtained the spectrum of the dominant states 
at distance q from a given fixed state. This spectrum shows that below a certain value of the overlap, the 
number of the dominating states is exponential in N, while above this value (close states) this number is 
of order N. Besides, we have seen that the states nearest to any given state always have higher energy 
density. 

We want to mention here a working hypothesis that could be useful for the present investigation. In 
the Generalized Random Energy Model of [25], an ultrametric structure is directly built in by defining 
the probability distributions of the energies at each clustering level. In this context, an equivalent of the 
functional order parameter x(q) of [7,8] can be identified. In [25] this construction is explicitly performed 
in the case of two clustering levels: in this simple example one can see that a function x{q) which decreases 
with increasing q corresponds to a hidden ultrametric structure, in the sense that this structure is present 
by construction, but is not revealed from the computation of the free energy of the system. This suggests 
that also for the p-spin spherical model, where a rich distribution of states is present but hard to reveal, 
an anomalous function x{q) could describe the underlying hidden structure. The existence of anomalous 
solutions of this kind in the context of the replica approach has been shown and discussed in [1,26,27,12]. 

To conclude, the main open issue on this topic is the pursuit of a unifying frame into which inserting 
all the results we have obtained, in order to describe in a synthetic way the rich and complex structure 
of states of the p-spin spherical model. 



Acknowledgements . 

It is a pleasure to thank for important suggestions and very useful discussions Alain Barrat, Leticia 
Cugliandolo, Silvio Franz, Jorge Kurchan, Marc Mezard, Rcmi Monasson, Heiko Rieger, Felix Ritort and 
Miguel Angel Virasoro. 



- 15 - 



Appendix A: The comparison with the real replica method. 

The real replica method [1,2,3,28] consists in studying the static properties of a certain number of real 
replicas of the system, as a function of the overlaps imposed among them. In [3] we introduced a three 
replica potential by which we analyzed the structure of equilibrium and metastable states of the p-spin 
spherical model: the first replica is fixed into an equilibrium state, while the second replica is forced to 
equilibrate at overlap q\2 with the first one. Clearly, the way in which replica 2 chooses its constrained 
equilibrium state is heavily conditioned by the complexity S c of the states at that distance. Once fixed 
replicas 1 and 2, the potential V3 is defined as the free energy density of a third replica 3 as a function of 
its distances 913 and g 2 3 from the first two. The most important minimum of V3 corresponds to replica 
3 in local equilibrium into the state chosen by replica 2. In this minimum, that we call M 2 , the energy 
and the self overlap of replica 3 satisfy TAP equations, meaning that replicas 2 and 3 have found a state 
of the unconstrained system at distance q\2 from the equilibrium state of replica 1 . 

Before proceeding further it is crucial to clarify the different roles of the three replicas, beginning from 
the way in which replica 2 chooses the state at distance q±2 from 1. If the TAP free energy is minimized 
on the manifold defined by fixing q i2 , the number of minima found is clearly greater than the number of 
genuine TAP solutions at that distance and for the most part consists of projections on the manifold of 
nearby true TAP solutions. These projections are what replica 2 sees as states. Therefore, we can say 
that replica 2 thcrmalizes in the vicinity of a TAP solution, but this solution is in general at distance 
q 7^ <Zi2 from replica 1. On the other hand, this TAP solution is that into which replica 3 thcrmalizes 
giving the minimum M 2 , and this is why replica 3 gives the right TAP energy of this state and its right 
distance from replica 1, while replica 2 does not. To understand the energy spectrum of the states visited 
by replica 3, we must then investigate how replica 2 chooses these states. 

As usual, replica 2 tries to optimize the balance between the free energy and the complexity of the 
solutions it finds on the manifold, minimizing a function $2 = f 2 — TE 2 (/ 2 , qi 2 ). It is important to note 
that S 2 is not the same function as S c : There are many genuine TAP solutions with different TAP free 
energies / and at slightly different distances q, either higher or lower than gi 2 , whose projections on the 
manifold of replica 2 all have the same free energy / 2 . Of these TAP solutions the relevant ones are those 
with the maximum complexity T, c (f,q). This maximum value will then give E 2 (/ 2 ,<7i 2 ). Summarizing, 
^2(/2, 912) is equal to the complexity S c of the most numerous TAP solutions whose projections on the 
manifold fixed by <ji 2 have free energy / 2 (the computation of S 2 is explicitly performed in [21]). 

The minimization of </> 2 with respect to / 2 then selects a particular class of TAP solutions. Replica 
2 is quenched into one of these solutions in the distorted way explained above, while replica 3 truly 
thermalizes into it. For this reason, the dependence on q i2 of the energy of replica 3 in the minimum M 2 
is a mere manifestation of the process of equilibration of replica 2 above described. 

Resuming, the states visited by replica 3 are chosen minimizing <p 2 , which does not coincide with the 
function (f> c of Section 4 as well as S 2 is not the same function as S c . Nevertheless, it is clear that the 
spectrum given by the minimization of 2 must be similar to the one given by (f) c in Section 4. 

To make then a comparison with Figure 6, it is convenient to plot the zero temperature energy of 
replica 3 in the minimum M 2 as a function of the overlap (713, instead of qi2, since, as stated above, qi3 
better represents the real overlap between the two states. This parameterization is possible because in 
the minimum M 2 the values of qis is uniquely determined by q 12 - 
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Figure Al: The energy density E of replica 3 in the minimum M 2 of the three replica potential, as a function of the 
overlap q 13 , for /3=1.64 and p=3. Here, as in Figure 6, <j max =0.360. 

It can be seen from a comparison between Figure 6 and Figure Al that, as we expected, the processes 
of minimization of <j> c and 4>2 are qualitatively the same: 

Firstly, we note from Figure Al that there is a value of qi 3 for which the curve has a cuspid; we call 
the corresponding value of g 12 in the minimum M 2 for which this cuspid occurs, q rs b- Indeed, following 
the same line of reasoning of Section 4, we argue that this cuspid must correspond to the point in which 
Y12 becomes zero. The computation developed in [3,21] shows that for value of gi2 greater than q rs b the 
overlap matrix Q 22 of replica 2 breaks the replica symmetry. Physically, an RS form of the overlap matrix 
means either that the systems finds an exponentially high number of states (as in the p-spin model for 
T s < T < Td), or that the phase space consists in just one state (as in the paramagnetic case). On the 
other hand, an RSB form means that the phase space is dominated by a number of order N of states (as 
in the p-spin model for T < T s ). Therefore, the breaking of the replica symmetry of Q 22 for q i2 = q rs b 
is a strong indication that here replica 2 ceases to see an exponentially high number of dominant states 
and confirms that in this point S2 becomes zero, as we argued above. As already stressed, the functions 
tf>2 and <p c , even though they have a similar physical meaning, are actually different and this is why the 
corresponding minimization curves (first branches in Figures 6 and Al) are different. 

Secondly, in Figure Al we note a maximum for 913 = q maxi i.e. exactly in the same point as in 
Figure 6. This is a consequence of the reversing in the behaviour of S c that occurs in the anomalous 
regime. This behaviour is directly inherited by S2: loosely speaking, if there are TAP solutions whose 
number starts to increase getting closer to the state of replica 1, the corresponding projections on a fixed 
manifold will increase too. This is an important confirmation of the role of the quantity q ma x and, as a 
consequence, it is a confirmation of the existence of the anomalous regime. 

Finally, it is worth observing that the ending points of the two curves are different, i.e. the potential 
V3 ceases to see states around replica 1 at a distance that is greater than the one corresponding to the 
nearest TAP solutions given by S c . This can signify either that the potential fails to see these last states 
because replica 2 does not thermalizes in the vicinity of them, or that these last solutions given by S c 
actually are not minima of the TAP free energy. At the present moment this is an open question. 



Summarizing the considerations of this Appendix we can say that the energy spectrum given by the 
real replica method is well explained by the behaviour of the constrained complexity. This mutually 
confirms the results found with the two methods. 
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